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METHOD AND APPARATUS FOR EFFICIENT DETERMINATION OF 
RECOGNITION PARAMETERS 
Attorney Docket Number 
1151 

Express Mail Label Number 
EL528759599US 

Inventor 
Kishan B. Shah 
Field of the Invention 

The present invention is related to computer software 
and more specifically to computer software for optical 
recognition of objects. 

Background of the Invention 

Computer software can be used to recognize digital 
representations of objects. For example, optical character 
recognition software can be used to recognize digital 
representations of character objects, typically obtained by 
scanning a printed page, segmenting the page into 
characters, and identifying characteristics of each 
character. Rules are used to narrow the choice of 
characters to a smaller range of characters, and a 
confidence level is assigned to each character in the 



08/04/00 - 12:46 PM 



1 



smaller range. The character with the highest confidence 
level may be selected as the recognized character. 

Some computer software for object recognition uses 
parameters to allow the software to be adjusted. The use 
5 of parameters allows the software to be tuned in a 
laboratory to particular conditions simulating the 
environment of anticipated operation of the software. 
Before the software is shipped as part of a product, the 
parameters are fixed at a constant level that yielded the 
10 optimum recognition in the laboratory simulation for that 
product . 

For example, if a scanned image represents the image 
using pixels, each having a greyscale value of 0-255, one 
parameter of the optical character recognition software may 

15 be to identify which values correspond to a part of the 

image to be recognized, in order to distinguish that part 
of the document from the greyscale value of the background. 
For example, a document received via a fax that is 
photocopied onto off-white paper may have text that has a 

2 0 greyscale reading of 2 00, while the remainder of the page 
may have a greyscale reading of 100. A printed black and 
white document may have a greyscale reading of 240 for text 
and 3 0 for the remainder of the page. Text on a printed 
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color document may have a greyscale reading as low as 90 
with a greyscale reading of 70 for portions of the 
background. These various values may be used to determine 
that an optimal cutoff greyscale reading of 150 should be 
5 used for the software. While this value provides a good 
compromise for high- contrast documents such as most black 
and white documents, certain color text on color background 
documents simply will not be recognized with this parameter 
value. If the parameter were lowered to 80 to accommodate 
10 recognition of color documents, some black and white 
documents would not be recognized, such as the fax 
photocopied onto off white paper. 

It would be desirable to have the parameter selection 
process vary for each set of objects, such as characters on 

15 the page, rather than selecting a single value for each 

parameter and using that same value for all objects. This 
would allow the parameter values to change for every page 
or part of a page, causing the parameters to be optimized 
for every circumstance. In the example above, it would be 

20 desirable to use a greyscale threshold of 150 for the faxed 
document and a threshold of 80 for the color document, 
instead of using a value of 150 every time. 
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While it is possible to make several attempts at 
recognizing the objects, such as characters in the file, 
using different parameters for each attempt, and then 
selecting the attempt that yields the highest recognition 
5 confidence, such a process would add too much time to the 
recognition process to be practical. Although computing 
power increases every year, because users prefer to use the 
additional computing power to process images of higher 
resolution rather than improve the accuracy of the 
10 recognition, making several attempts at recognizing an 
image could take too long to be useful , 

What is needed is a method and apparatus that can 
optimally set the parameters of an optical recognition 
without significantly adding time to the recognition. 

15 Summary of Invention 

A method and apparatus receives a digitized 
representation of an image at a first resolution, then 
produces a lower resolution version of the image. The 
method and apparatus then attempts multiple recognitions on 
20 the reduced-resolution version of the image using different 
parameters for each recognition and records the confidence 
level of the attempt. The parameters that yielded the 
highest confidence level on the attempt using the lower 

08/04/00 - 12:46 PM A 



resolution version can then be used to perform the 
recognition on the higher-resolution version of the image. 

Brief Description of the Drawings 

Figure 1 is a block schematic diagram of a 
5 conventional computer system. 

Figure 2 is a block schematic diagram of a system for 
identifying optimal parameters for optical object 
recognition according to one embodiment of the present 
invention. 

10 Figure 3 is a flowchart illustrating a method of 

identifying optimal parameters for optical object 
recognition according to one embodiment of the present 
invention . 

Detailed Description of a Preferred Embodiment 

15 The present invention may be implemented as computer 

software on a conventional computer system. Referring now 
to Figure 1, a conventional computer system 150 for 
practicing the present invention is shown. Processor 160 
retrieves and executes software instructions stored in 

2 0 storage 162 such as memory, which may be Random Access 

Memory (RAM) and may control other components to perform 
the present invention. Storage 162 may be used to store 
program instructions or data or both. Storage 164, such as 
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a computer disk drive or other nonvolatile storage, may 
provide storage of data or program instructions. In one 
embodiment, storage 164 provides longer term storage of 
instructions and data, with storage 162 providing storage 
5 for data or instructions that may only be required for a 
shorter time than that of storage 164. Input device 166 
such as a computer keyboard, mouse, scanner, digital camera 
or any or all of these allows user input to the system 150, 
Output 168, such as a display or printer, allows the system 

10 to provide information such as instructions, data or other 
information to the user of the system 150. Storage input 
device 170 such as a conventional floppy disk drive or CD- 
ROM drive accepts via input 172 computer program products 
174 such as a conventional floppy disk or CD-ROM or other 

15 nonvolatile storage media that may be used to transport 

computer instructions or data to the system 150. Computer 
program product 174 has encoded thereon computer readable 
program code devices 175, such as magnetic charges in the 
case of a floppy disk or optical encodings in the case of a 

2 0 CD-ROM which are encoded as program instructions, data or 
both to configure the computer system 150 to operate as 
described below. 

In one embodiment, each computer system 150 is a 
conventional Intel Pentium/Celeron compatible computer such 
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as the model 6540C commercially available from Hewlett 
Packard Corporation of Palo Alto, California, running the 
Windows operating system commercially available from 
Microsoft Corporation of Redmond Washington, although other 
5 systems may be used. 

Referring now to Figure 2 a system for identifying 
optimal parameters for optical object recognition is shown 
according to one embodiment of the present invention. The 
description below uses characters as the objects, however, 

10 objects can be shapes, people, three-dimensional items or 
any other object. Native resolution image storage 210 
receives at input 208 a digitized representation of an 
image from an optical scanning device such as a scanner or 
digital camera at input 208. Native resolution image 

15 storage 210 contains conventional memory such as random 
access memory or other types of storage and stores the 
digitized representation of the image in this storage. As 
native resolution image storage 210 receives an image, it 
signals downsampler 212. 

2 0 In one embodiment, the digitized representation of the 

image stored in native resolution image storage 210 is made 
up of an array of pixels at a resolution. For example, the 
digitized representation of the image may be represented 
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with a resolution of 1200 x 1200 pixels per inch. ^ Thus, an 
8.5 by 11 inch document may be represented by 134,640,000 
pixels. The digitized representation of the image may be 
stored using conventional compression techniques, so the 
5 number of pixels stored in native resolution image storage 
210 may be less than the 134,640,000 pixels for that size 
document, even though that many pixels are represented by 
the digitized representation of the image. Each of the 
pixels may have one or more values. A greyscale image may 
10 have a greyscale value. A color image may have a pair of 
values: one representing luminance or intensity, and 
another value representing chromiance or color. 

Downsampler 212 retrieves the digitized representation 
of the image from native resolution image storage 210, 

15 reduces the resolution, and stores the result into low 

resolution image storage 214. Downsampler 212 reduces the 
resolution by selecting a set of pixels, computing an 
average representation of the value or values of the pixels 
in the set, and then representing the entire set of pixels 

2 0 selected by a single pixel (or a number of pixels fewer 
than the number of pixels in the set) having the average 
value or values of the set of pixels selected. If the 
digitized representation of the image is compressed, 
downsampler 212 decompresses the image before reducing the 
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resolution and may optionally compress the result prior to 
storage into low resolution image storage 214. 

For example, if the resolution is 1200 dpi and it is 
desired to reduce the resolution to 3 00 dpi, downsampler 
5 212 selects from native resolution image storage 210 a set 
of sixteen pixels from the upper left hand corner of the 
image, four pixel columns wide and four pixel rows tall, 
and averages the values from these pixels to produce a 
single pixel, which is output to low resolution image 

10 storage 214. Low resolution image storage 214 contains 

conventional storage such as memory or disk storage. The 
four pixels adjacent to these in each of the same four rows 
are selected and the process is repeated by downsampler 212 
and so on until the end of the row is reached. When the 

15 end of the row is reached, downsampler 212 selects the next 
four rows and repeats the process described above for these 
rows. It isn't necessary to proceed step-by-step in this 
fashion, nor is it necessary to average the values. For 
example, the values may be smoothed using conventional 

20 smoothing techniques. When downsampler 212 has completed 
reducing the resolution of the digitized representation of 
the image, downsampler 212 signals parameter selector 220. 
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Parameter selector 220 selects an initial set of one 
or more parameters and passes them to recognition engine 
216. Recognition engine is any conventional recognition 
engine such as an optical character recognition engine that 
5 can accept a set of parameters, identify a segment of an 

image, and provide the one or more characters recognized at 
the highest confidence level and also supply that 
confidence level, which may be a value between 0 and 1. 
Recognition engine 216 performs conventional optical 

10 character recognition techniques using the parameters 
provided by parameter selector 22 0 on the reduced 
resolution version of the digitized representation of the 
image that is stored in low resolution image storage 214. 
In one embodiment, recognition engine 216 segments the 

15 image into characters or words and then attempts to 

recognize the character or word using conventional optical 
character resolution techniques on each segment. Optical 
character recognition is described in Bunke 8c Wang, ed. , 
Handbook of Character Recognition and Document Image 

20 Analysis (1997 World Scientific Publishing Co. Pte. Ltd, 
Singapore, ISBN 981-02 -2270-X) . Other forms of object 
recognition may also be used such as handwriting 
recognition, described in S Impedoio and J Simon, eds . From 
Pixels to Features III" (1992 Elsevier Science Publishers, 
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B.V., Amsterdam), Source code for an optical character 
recognition engine is publicly available from the National 
Institute of Standards and Technology, Gaithersburg, 
Maryland, 20899 and is described in Garris et al, "Public 
5 Domain Optical Character Recognition", Proceedings, SPIE 
Volume 2422, pp2-15, and this engine may be suitably 
modified as described herein. 

Parameter selector 220 selects another set of 
parameters and passes them to recognition engine 216 and 
10 signals recognition engine to repeat the recognition 

process described above on the same segment of the image it 
just processed, and recognition engine 216 complies with 
the request. This process may be repeated a number of 
times, each time with a different set of parameters. 

15 In one embodiment, each time another set of parameters 

is selected and provided by parameter selector 22 0, the 
value of only one of the parameters is varied until several 
different values of that parameter have been selected and 
provided to recognition engine 216 by parameter selector 

20 220. When all possible values of that parameter have been 
provided or when an acceptable value has been identified, 
that parameter is set to a particular value and the value 
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of a different parameter is varied, and so forth until all 
the parameters have been varied. 

For example, assume two parameters, parameter 1 and 
parameter 2, with possible values of Al, Bl, CI and Dl for 
5 parameter 1 and values A2 and B2 for parameter 2 . The sets 
of parameters provided by parameter selector 22 0 could be 
(Al, A2), (Bl, A2), (CI, A2), (Dl, A2) , (Al , B2) , (Bl, B2), 
(CI, B2) , (Dl, B2) . 

It is not necessary to provide all possible values: 
10 for example, a binary search technique may be used or a 

discrete set of parameter combinations may be provided with 
multiple parameters changing from one set of parameters to 
the next. For example, the parameter values provided by 
parameter selector 220 could be limited to (Al, A2) , (Bl, 
15 B2) , (CI, A2) , (Dl, B2) , 

Each time the parameters are provided to recognition 
engine, parameter selector 220 provides those parameters or 
an indicator of the parameters to optimal parameter 
identifier 222. In addition, recognition engine provides 
2 0 the confidence level of the character recognition to 

optimal parameter identifier. Optimal parameter identifier 
222 records the parameters and the confidence level so that 
the optimal value for the parameters may be identified by 
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selecting values of parameters that yield the highest 
confidence levels . 

In one embodiment, optimal parameter identifier 
identifies the optimal value for a parameter by choosing 
5 the value of a parameter that yielded the highest 
confidence level for the recognition performed by 
recognition engine 216. In another embodiment, if the 
confidence level exceeds a threshold, such as 0.95, optimal 
parameter identifier 222 signals parameter selector 220 to 
D 10 select no further values of that parameter. This way, if 
fl an acceptable value is reached, the system 200 does not 

P continue searching for a better one: the acceptable value 

yj is used as the optimal value. 

y In one embodiment, when an optimal value for a 

^ 15 particular parameter has been identified, optimal parameter 
S identifier 222 provides the value of the optimal parameter 

to parameter selector 220 to use in all remaining parameter 
selections it makes as described above. In another 
embodiment, a preset value may be used in place of the 
2 0 optimal parameter for use in attempting to identify the 
optimal value of a different parameter. 

When the optimal values of all of the parameters have 
been identified as described above, optimal parameter 
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identifier 222 signals recognition engine with the optimal 
values of all parameters. Recognition engine 216 selects 
the segment of the digitized representation of the image in 
native resolution image storage 210 that corresponds to the 
segment in low resolution image storage 214 that was used 
to select the optimal parameters and performs an optical 
character recognition of the segment from native resolution 
image storage 210. In one embodiment, recognition engine 
216 uses the same character recognition techniques that it 
used on the lower resolution version of the image to 
recognize the higher resolution version of the image. In 
another embodiment, a different character recognition is 
used for the different resolution versions of the image. 
In one embodiment, when recognition engine completes the 
optical character recognition of the higher resolution 
image, it outputs at output 218 a representation of the 
object or objects recognized and signals parameter selector 
22 0 so that the process may be repeated on a different 
segment of the image. The representation of the object or 
objects recognized may be an ASCII character as well as 
font descriptions and the like or may be a code for a 
particular object, such as a rubber band or a circle. In 
another embodiment, recognition engine 216 attempts to 
recognize the next segment from native resolution image 
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storage 210 using the same parameters as the last segment, 
and only signals parameter selector 220 to begin the 
process of parameter selection again if the confidence 
level of the recognition for the segment falls 
5 significantly below the confidence level of the last 
recognition or falls below a certain preset value. 

Referring now to Figure 3, a method of identifying 
optimal parameters for optical object recognition is shown 
according to one embodiment of the present invention. The 

10 description below uses characters as objects, but an object 
may also be noncharacter things as described above. An 
digital representation of an image is received and stored 
310 at a first resolution, such as a native resolution of a 
scanning device as described above. A reduced-resolution 

15 version of some or all of the image received in step 310 is 
produced and stored 312 as described above. A segment is 
selected 314, either from the image received in step 310 or 
the version of the image produced in step 312. An initial 
set of parameters are selected 316 as described above. An 

2 0 attempt is made to recognize one or more objects such as 
characters in the segment from the reduced resolution 
version of the image, and the highest confidence level 
obtained from the attempt is produced 318. If there are 
additional combinations of parameters 320, a different 
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combination is selected as described above 322 and the 
method continues at step 318 using the different 
combination of parameters. When the selection and testing 
the recognition from the combinations of parameters is 
5 completed as described above 320, the optimal parameters 
are identified 324 as described above. The segment of the 
image received in step 310 is then recognized using the 
optimal parameters 326 and the character or characters 
recognized from the segment of the image received in step 
10 310 are output 326. If there are more segments 328, the 
next segment is selected 33 0 and the method continues at 
step 316 using the selected segment, and otherwise, the 
method terminates 332. 

In an alternate embodiment of the present invention 
15 illustrated by the dashed lines in the figure, when the 

next segment is selected at step 330, instead of continuing 
at step 316, the method continues at step 340, At step 
340, the segment from the digitized representation of the 
image received in step 310 is recognized and a confidence 
2 0 level is identified. If the confidence level is acceptable 
as described above 342, the character or characters 
recognized in step 340 are output and the next segment is 
selected 344, and the method continues at step 340. 
Otherwise 342, the method continues at step 316 to identify 
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values of parameters to use for the segment on which the 
recognition was attempted in step 340 but acceptable 
recognition confidence was not achieved. 
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What is claimed is: 

]/ A method of recognizing at least one object in a 
digitized representation of an image, comprising: 

receiving the digitized representation of the image, 
the representation having a first resolution; 

creating a reduced-resolution version of the image 
responsive to the digitized representation of the image, 
the reduced-resolution version of the image having a second 
resolution lower than the first resolution; and 

identifying a value of each of at least one 
recognition parameter using the reduced resolution version 
of the image; and 

recognizing the at least one object represented in the 
digitized representation of the image responsive to the 
value of each of the at least one recognition parameter 
identified. 

2. The method of claim 1 wherein the identifying step 
comprises : 

providing a plurality of sets of values of at least 
one parameter; 

for each of the sets of at least one parameter, 
identifying a confidence level of recognition by attempting 

08/04/00 - 12:46 PM 18 



to recognize from the reduced-resolution version of the 
image the at least one object responsive to the at least 
one parameter in the set; and 

selecting at least one of the values of the at least 
one parameters in the set responsive to the confidence 
levels identif ied- 

3. The method of claim 2 wherein the selecting step 
comprises selecting a value of each of at least one 
parameter corresponding to a highest confidence level from 
a plurality of the confidence levels identified. 

4. The method. of claim 2 wherein the selecting step 
comprises selecting a value of each of at least one 
parameter corresponding to a confidence level exceeding a 
threshold. 

5. The method of claim 1 wherein the creating step 
comprises calculating an average of at least one value of a 
plurality of pixels of the digitized representation of the 
image . 

6. The method of claim 1 additionally comprising 
recognizing at least one additional object represented in 
the digitized representation of the image responsive to the 
value of at least one recognition parameter identified 
responsive to a confidence level exceeding a threshold, 

08/04/00 - 12:46 PM 2.9 



7. The method of claim 1 additionally comprising: 

attempting to recognize at least one additional object 
represented in the digitized representation of the image 
responsive to the value of at least one recognition 
parameter identified, the attempting step comprising 
producing a confidence level of the attempt; and 

responsive to the confidence level of the attempt 
below a threshold: 

repeating the identifying step; and 

recognizing the at least one object represented 
in the digitized representation of the image 
responsive to the value of each of the at least one 
recognition parameter identified during the repeating 



useable medium having computer readable program code 
embodied therein for recognizing at least one object in a 
digitized representation of an image, the computer program 
product comprising: 

computer readable program code devices configured to 
cause a computer to receive the digitized representation of 
the image, the representation having a first resolution; 



step . 




A computer program product comprising a computer 
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computer readable program code devices configured to 
10 cause a computer to create a reduced-resolution version of 
the image responsive to the digitized representation of the 
image, the reduced-resolution version of the image having a 
second resolution lower than the first resolution; and 

computer readable program code devices configured to 
15 cause a computer to identify a value of each of at least 
one recognition parameter using the reduced resolution 
version of the image; and 

computer readable program code devices configured to 
cause a computer to recognize the at least one object 
20 represented in the digitized representation of the image 
responsive to the value of each of the at least one 
recognition parameter identified. 

9 The computer program product of claim 8 wherein the 
computer readable program code devices configured to cause 
a computer to identify comprises: 

computer readable program code devices configured to 
5 cause a computer to provide a plurality of sets of values 
of at least one parameter; 

computer readable program code devices configured to 
cause a computer to, for each of the sets of at least one 
parameter, identify a confidence level of recognition by 
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attempting to recognize from the reduced-resolution version 
of the image the at least one object responsive to the at 
least one parameter in the set; and 

select at least one of the values of the at least one 
parameters in the set responsive to the confidence levels 
identified. 

10. The computer program product of claim 9 wherein 
the computer readable program code devices configured to 
cause a computer to select comprise computer readable 
program code devices configured to cause a computer to 
select a value of each of at least one parameter 
corresponding to a highest confidence level from a 
plurality of the confidence levels identified. 

11. The computer program product of claim 9 wherein 
the computer readable program code devices configured to 
cause a computer to select comprise computer readable 
program code devices configured to cause a computer to 
select a value of each of at least one parameter 
corresponding to a confidence level exceeding a threshold. 

12 . The computer program product of claim 8 wherein 
the computer readable program code devices configured to 
cause a computer to creating comprise computer readable 
program code devices configured to cause a computer to 
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calculate an average of at least one value of a plurality 
of pixels of the digitized representation of the image. 

13 . The computer program product of claim 8 
additionally comprising computer readable program code 
devices configured to cause a computer to recognize at 
least one additional object represented in the digitized 
representation of the image responsive to the value of at 
least one recognition parameter identified responsive to a 
confidence level exceeding a threshold. 

14. The computer program product of claim 8 
additionally comprising: 

computer readable program code devices configured to 
cause a computer to attempt to recognize at least one 
additional object represented in the digitized 
representation of the image responsive to the value of at 
least one recognition parameter identified, the computer 
readable program code devices configured to cause a 
computer to attempt comprising computer readable program 
code devices configured to cause a computer to produce a 
confidence level of the attempt; and 

computer readable program code devices configured to 
cause a computer to, responsive to the confidence level of 
the attempt below a threshold: 
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repeat the identifying step; and 

recognize the at least one object represented in 
the digitized representation of the image responsive 
to the value of each of the at least one recognition 
parameter identified during operation of the computer 
readable program code devices configured to cause a 
computer to repeat . 

A system for recognizing objects, the system 
comprising : 

a downsampler having an input coupled to a system 
input operatively coupled for receiving a representation of 
an image having a first resolution, the downsampler for 
producing and providing at an output a reduced-resolution 
version of the image responsive to the representation of 
the image received at the downsampler input, the reduced 
resolution version of the image having a second resolution 
lower than the first resolution; and 

a recognition engine having a first input coupled to 
the downsampler output for receiving the reduced-resolution 
version of the image and a second input coupled to the 
system input for receiving the representation of the image, 
the recognition engine for: 
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at least attempting to recognize at least one first 
object in the reduced resolution version of the image 
received at the first input, at least one time; 

recognizing at least one second object in the 
20 representation of the image received at the second input; 
and 

providing a representation of the at least one object 
recognized at a first output coupled to a system output. 

16. The system of claim 15 wherein: 

the system additionally comprises a parameter selector 
for selecting and providing at an output a plurality of 
sets of parameters, each set different from at last one of 
5 the other sets; and 

the recognition engine additionally has a third input 
coupled to the parameter selector output for receiving the 
plurality of sets of parameters and the recognition engine 
performs the attempt on the at least one object at least 
10 one time for each of the sets of parameters received at the 
third recognition input. 

17. The system of claim 16: 
wherein the recognition engine: 
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additionally has a fourth input for receiving an 
additional set of parameters; 

performs the recognizing responsive to the 
additional set of parameters; 

is additionally for providing a recognition 
confidence level at a second output responsive to said 
attempt, for each of the at least one times; and 

the system additionally comprising a parameter 
identifier having a first input coupled to the recognition 
second output for receiving the recognition confidence 
level for each of the at least one times, and a second 
input coupled to the parameter selector output for 
receiving each of the sets of parameters, the parameter 
identifier for selecting and providing at an output coupled 
to the fourth recognition engine input the additional set 
of parameters responsive to the sets of parameters received 
at the parameter identifier second input and the 
recognition confidence level for each of the at least one 
times received at the parameter identifier first input. 

18. The system of claim 17 wherein the parameter 
identifier selects the additional set of parameters 
additionally responsive to a threshold confidence level, 

19, The system of claim 17 wherein: 
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the at least one time comprises a plurality of times; 

and 

the parameter identifier selects the additional set of 
parameters responsive to a confidence level for at least 
one of the at least one times relative to at least one 
other confidence level for at least a different of the at 
least one times. 

20. The system of claim 20 wherein the recognition 
engine additionally recognizes at least one third object in 
the representation of the image received at the second 
input responsive to the additional set of parameters and a 
confidence level corresponding to the at least one third 
object . 
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Abstract of the Disclosure 

A method and apparatus creates a reduced-resolution 
version of an image and uses the reduced resolution version 
to identify recognition parameters. The recognition 
5 parameters are then used on the original version of the 

image to recognize objects such as characters in the image. 
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